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ABSTRACT 


In this paper we construct a relationship between the Allan variance parame- 
ters (h 2 , hi, hg, h_i and h_ 2 ) and a Kalman Filter model that would be used to 
estimate and predict clock phase, frequency and frequency drift. To start 
with we review the meaning of those Allan Variance parameters and how they are 
arrived at for a given frequency source. Although a subset of these parame- 
ters is arrived at by measuring phase as a function of time rather than as a 
spectral density, they all represent phase noise spectral density coef- 
ficients, though not necessarily that of a rational spectral density. 


The phase noise spectral density is then transformed into a time domain 
covariance model which can then be used to derive the Kalman Filter model 
parameters. Simulation results of that covariance model are presented and 
compared to clock uncertainties predicted by Allan variance parameters. A two 
state Kalman Filter model is then derived and the significance of each state 
is explained. 
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INTRODUCTION 


The NAVSTAR Global Positioning System (GPS) has brought about a challenge — 
the challenge of modeling clocks for estimation processes. The system is very 
reliant on clocks, since its navigation accuracy is directly related to clock 
performance and the ability to estimate and predict time. 

The estimation processes are usually in the form of Kalman Filters, or vari- 
ations thereof such as Square Root Information Filters. These filters range 
from the large Ephemeris Determination Filter in the Control Segment, to 
Navigation Filters in the User Equipment, to Positioning Filters for station- 
ary positioning or for merely solving for time and frequency in a Time Trans- 
fer system. In all of these applications, clock states and thus clock models 
exist. No i. all of the models are necessarily proper. 

It is the purpose of this paper to shed some light on how to model clocks for 
Kalman Filters. The presentation of clock statistics as Allan Variances has 
frustrated systems engineers for some time now because they don't know how to 
interpret them or how they can be used to predict system performance. The 
problem is even compounded because flicker noise is not a rational process. 

In the past. Dr James Barnes and Dave Allan had shed some light on 
the clock modeling problem, although some of it was well in the past 
(1966)^. For some young modern day engineers, this work is hidden in old 
IEEE proceedings and NBS Technical Notes. Here, we are going to resurrect 
some of that work and form it into Kalman Filter models, but not without 
problems because of the flicker noise phenomenon. 

Review of the Allan Variance Parameters 


The Allan Variance parameters of an oscillator or atomic frequency standard 
are based on measurements of phase differences between that oscillator or 
atomic standard and a reference standard (which may be a low phase noise 
crystal oscillator for short term - high frequency measurements). These 
measurements are processed in two ways -- spectral analysis for higher 
frequency phase noise and time domain analysis for the relatively low 
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frequency variations. The single sided phase noise spectral density is 
converted to a single-sided spectral density of fractional frequency 
fluctuation of the form ^ 

S y (f) = h 2 f 2 + h x f + h Q + h_ 1 /f + h_ 2 /f 2 ; f 1 <f <f h 1) 

where f] and f^ define the measurement system noise bandwidth, and where the 
h a coefficients represent the following processes: 

h£ - white phase noise 
hj - flicker phase noise 
hQ - white frequency noise 
h_i - flicker frequency noise 
h _2 - random walk frequency noise 


Normally the spectral density of equation 1 is obtained from a combination of 
the measured single-sided phase noise spectral density in radians/squared/Hz 
by 


V f > - 72 V f > 


2) 


for a nominal frequency f 0 , and from the square root of the Allan two-sample 
variances, o y (T), which are computed as ^ 


2, , < y k+l - y k )2 
°y (t) = 2 

1 M' 1 - - 2 

3 2(M— 1) < y k+l " y k^ 

where < > is the expected value operator and 


3) 

4 ) 


V T 


= t I y(t)dt = 


♦ (t k + r) - <p(t k ) 


2nf 0 T 


5) 


where ^(t^) are the measurements of the phase differences mentioned earlier. 
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When plotted, oy(r), as shown in Figure 1, has the form ^ 


2 , ''o - 1 

°y ( T ' ' ~2 T 


«w (t) = (21n2)h_ 1 


2 l \ - ( 2 *) h 
°y ( T ) " 6" h -2 T 


for white, flicker and random frequency noises, respectively. In this paper 
we will only consider those three processes in the time domain for the Kalman 
Filter model. However, the white and flicker phase noises will be considered 
later in the model of the Kalman Filter measurement noise. 

As can be seen, the h a parameters can be obtained from two sources — the 
single-side band (SSB) phase noise plot of a specification of an oscillator or 
frequency standard and its stability specification, which is given in terms of 
the Allan two-sample standard deviation. The SSB phase noise spectrum is 
usually given in dBc/Hz, or 

S (f) = 201ogf Q + 101og[h 2 + hj/f + h Q /f 2 + h_ 1 /f 3 + h_ 2 /f 4 ] 9) 

Also of interest in later discussions is the spectral density of time 
fluctuation x(t) in seconds, where 

x(t) = *(t)/2nf n 10) 


so that 


S x (f) ■ — ~ 2 s (f) 


777 |h 2 + V f + V f2 + h -i /f3+ h - 2 /f4 l 

(2ir) 


in seconds squared per Hz. 




FIGURE 1 °V (r) OF A TYPICAL FREQUENCY SOURCE 










Transformation to a Statistical Covariance Model 

Here, the work of Barnes and Allan is expanded a bit to develop a co- 
variance model that at least provides an "uncertainty" model one might use in 
a Kalman Filter.* An "uncertainty" model is defined here as one that has the 
variance propagation characteristics of a process, although the time auto- 
correlation properties may be wanting. This is not unusual in modeling for a 
Kalman Filter where large size state models are not feasible or when the 
process is not truly a definable stochastic process. For example, if we were 
to model position and velocity of a navigator in 6 states, where any acceler- 
ation excursions are considered an uncertainty in the change in position and 
velocity, that uncertainty is certainly not a "white noise" process by any 
means. 

Barnes and Allan only addressed the statistical model of flicker frequency 
noise. However, the models for white and random walk frequency noise are 
straightforward. Just in brief, they derived a convolution integral that 
related the phase fluctuation due to flicker frequency noise to white noise, 

where 

t 

z(t) = J h(t-u)n(u)du 12) 
o 

where h(t) is an impulse response of a transfer function and n(t) is a white 
noise process. The secret is in the derivation of that impulse response, 
which they did for the flicker noise. To provide a more general derivation of 
that impulse response, let us back up a bit. 

A theoretical definition of a white noise spectral density is a constant, such 
as the hg in equation 1. If it is possible, another spectral density can be 
related to a white noise spectral density as 


*For a tutorial on Kalman Filter Models, refer to Reference 4 by R. G. Brown, 

which is the previously presented paper in this meeting. i 

i 
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S 2 (u>) = |H(ja,)| 2 S w ( W ) 
= |H(jw) | 2 


13) 


where we define the white noise density to be unity. Let us do that for the 
bo* b_i and h _2 processes defined in equations 1 and 11, converting first to 
fractional frequency squared/radians/second and seconds squared/radians/- 
second, and then to a two sided spectral density S'. Then, 


S, (w) = h n /2 (white frequency noise) 

y 0 u 

14) 

S, w (u) = uh ,/ui (flicker frequency noise) 

y_l -l 

15) 

2 2 

S, (u») = 2-n h y/u (random walk frequency noise) 

y _ 2 

16) 

and correspondingly, and respectively 


Si (u) = h fl /2</ 
x 0 u 

17) 

S, (w) = irh ,/w 3 
X _1 '1 

CO 

*— H 

s, x ^*(w) = zA_ z /J 

19) 

These can all be factored into the Fourier Transform of the 

impulse response 

h(t), where respectively. 


H ( jto) = AU2 
y 0 u 

20) 

(j“) - Ah i//ju) 
y -l _i 

21) 

(j») = A A p/jcu 
-2 ~ c 

22) 

h (jo.) = /iy 27 ,o 
x o 

23) 

H x ^(jw) = Ahj /(jw) 3 ^ 2 
H x ( jtu ) = 

24) 

25) 


-2 
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Converting these to La Place Transforms (s=jw) and using tables from Reference 
5, we have the respective impulse responses 


'o (t) ■ 

y %?2 6(t) 

26) 


= ; t > o 

27) 

, (t) 
-2 

= 7T ; t > 0 

28) 

(t) - 

0 

l(t) ; t > 0 

29) 

(t) 

-1 

= 2/h^t ; t > 0 

30) 

(t) 

= it /2h ,,t ; t > 0 

31) 


Where 6 ( t) is the Dirac delta function and l(t) is the unit response function. 

We can now derive the autocorrelation, variance and cross-correlation 
functions of these processes from the following: 

The autocorrelation function is 


t t+x 

R(t,x) = [ J h(t-u)h(t+T-v) E[ n(u)n(v) jdvdu 32) 

0 0 


t 

= J h(u)h(u+T)du ; t > 0 33) 

0 


Using the property that 

E[ n(u)n(v) j = 6(u-v) 34) 

and that 

t+T 

J f(v)6(u-v)dv = f(u) 35) 

0 
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provided that 0<u<fc+-r, which it is if we restrict t to be greater than zero. 
The variance of a process is then 


a 2 (t) = R(t,0) 
t o 

= | h 2 (u)du 
0 

Similarly, the cross-correlation function between two processes is 



T > 0 


36) 


37) 


provided that they are driven by the same white noise process. (Otherwise 
R X y ( t , t ) is zero.) 


For each process then 
h 0 

R v (t.i) = 6 (t) 

y 0 c 


R (t,x) is undefined 

y -l 

R„ (t,t) = 2* 2 h 9 t ; t > 0 

h o 

R (t,x) = —i t ; t > 0 
x 0 * 

\ (t.t) = h.jRZt+t) &U- 

R x (t.T) = 2A_ 2 {\ t 3 + \ t 2 x ) 


38) 

39) 

40) 

41) 

42) 


R y ( t , t ) does not exist because its impulse response (equation 27) is 
infinite at t=0. However, if one bounds the flicker noise spectral density to 
a frequency region of fi < f < f^, such as suggested in Reference 2, a 
stationary process is defined and an autocorrelation function can be defined 
as the inverse Fourier Transfer of the spectral density as 
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/ \ u C h COSujt _j 

(,) = h -l * 2If T" d “ 

f. 1 

= h , In r~ + h 1 i 
_i r l ~ L n=l 


(-l) n 


(2TTf h T ) ?n -[2 1 Tf 1 T) 2n 

2n(2n) ! 


which is a well defined function of t. 


43) 


Then, the variances can be derived as 


\ 

44) 

- y 2 - h_,l» £ 
y -l 1 r l 

45) 

<y 2 2 (t) = 2n 2 h_ 2 t 

46) 

2 ^0 
x Q ^ = ~2 t 

47) 

2 (t) = 2h ,t 2 
X -1 

48) 

2 2 2, ,3 

x_ 2 ~ 3 ” h -2 l 

49) 


2 ? 

Here, is defined for a limited bandwidth f h and o x is derived 

from equation 36. Cross correlations between f regency ani time of like 

processes are then 


, x>o (t ’ T) 

o 

= ~2 ; t = o 

50) 


= 0 ; t > 0 


W Ut) 

= 2h ^2+ti - h 1 Tln(~ 2 '^ +tT + 2t+T ] 

51) 


= 7t 2 h 2 (t 2 +2tx) 

52) 


or, for zero correlation time (cross-covariances) . 
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R xy , * 2 h.lt 


R 


2. f 2 
= i h ,t 


xy_2 " "-2 


53) 

54) 

55) 


Equations 44 through 49 and 53 through 55 could be used to define a covariance 
matrix at any time t describing the combined uncertainty in instantaneous time 
and fractional frequency. That is 


C0V(x(t) ,y(t) 


0 2 2 2 3 

— 2 t + 2h j^t + -jit h 2 1 


0 2 2 
2+2h jt->-nh t 2 


-|+2h_ 1 t+ 1 T 2 h_ 2 t 2 


h 9 

h n f.+h -jlrfr — *"2 n h ~t 
0 h 0 _1 f l “ 2 


56) 


However, discrete Kalman filters do not estimate instantaneous frequency, but 
an average fractional frequency over a Kalman filter t’me interval At. Let 
that average fractional frequency be 


y( t ) = x(t+At) - x(t) 


57) 


Then, using equations 40 through 42 with x = At, but first simplifying 
equation 41 to a steady state value (large t/ T ) of 


R (t,t) » 2h . ( t +tt ) 

X -1 -1 

and equations 47 through 49, a new covariance can be computed, where 


58) 


COV [ x ( t ) ,y(t) 


0 2 2 2 3 

-^t + 2h_ L t + | /h_ 2 t 

2h_ 1 1 

2 2 
+ it h pt 

2h_ 1 t + /h 2 t 2 

h 0 

2At + 

2 2 

2h j n ll 



+ 2tt 2 H 2 t 


-2 


59) 
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all of which is a well-balanced function of t, except the 2,2 term that has 
terms as a function of at that basically describe the Allan standard deviation 
(within ln2). 

Transformation to a 2-state Kalman Filter Covariance Model 


It should be noted that both x and y are nonstationary random processes that 
grow with time. If we wish to obtain a measure of this growth over a at 
interval, we simply let t = at in equation f.; and obtain 


Cov[x(at), y(at)J = 


2^at+2h ^at^+jTT^h ^at 3 


2h_ 1 at+7T 2 h 2 at 2 


2h 1 at+?t 2 h_ 2 at 2 


o ,8 2, 


60) 


+-2h A +~-7i h n At 


2at -1 3 "-2 


We now propose the following 2-state Kalman filter model. Let the state 
variables be defined as 


x^ = x (i.e., time as before) 
X2 = "Noisy" average frequency 


61) 


The precise meaning of x? will be made apparent presently. Now, following the 
usual notat’c of Kalman filter theory (4], we let the transition matrix for 
a at interval be 





at 

1 


and we let the Q matrix be 


Q = Cov[x(at),y(at) i 


as given by equation 60. 


62) 


63) 


2 







We also postulate that we will step the estimate of the state vector and its 
error covariance ahead via che usual projection equations. 

X~(t+At) = 4>x(t) 64) 

P"(t+At) = «P(t)« T +Q 65) 

We will now have a proper Kalman filter model except for the measurement 
equation. This portion of the model depends on the situation at hand, so we 
will omit further discussion of this here. (For example, the clock model 
might be imbedded in a larger state model as in the GPS application [6].) 

We now need to explore more carefully the connection between our postulated 
state model and the x and y statistics as dictated by equation 60. First, by 
choosing our Q matrix as exactly that of equation 60, we are assured of having 
the proper growt^ of uncertainty in our time and average frequency estimates 
in the At interval. This is necessary in order to generate appropriate filter 
gains with each step of the estimation process. However, we cannot have X£ in 
our state model represent true average frequency, and at the same moment 
require the 1,1 term of the Q matrix to be nonzero. This is not compatible 
with the defining equation for average frequency. That is, equation 57 states 

x (t+At) = x(t)+At-y 66) 

Whereas, our state model says 

X^ (t+At) = X 1 (t)+At*x(t)+W )< 67) 

We have defined x^ to be x, and thus x£ must differ from y by the additive 
discrete white noise term w^/At. We are comforted, though, with the fact that 
the average X£ in the state model is equal to the usual average frequency. 

It should be noted that the Kalman filter model proposed here is entirely 
self-consistent in terms of state-space theory. The transition matrix is 
legitimate in that it reduces to the identity matrix for At=0; and Q is 
positive-definite for all At as it must be to be a legitimate covariance 
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matrix. The only inconsistency lies in the state model's connection to the 
x,y processes are described by equation 59. In view of the remarks about 
flicker noise in the companion paper in these Proceedings [4], we should not 
expect to be able to make this connection exact. No finite-order state model 
will fit flicker noise perfectly! Thus, something has to give. We intention- 
ally kept the identity of time exact in our model, i.e., xj=x. We then 
circumvented inconsistency in the state model by letting x£ be a noisy version 
of y. The filter's estimate of x^ is still a valid estimate of frequency, 
though, because the mean of x? 1S y* 

An Example 

Standard deviation plots of the time state x(t) of typical crystal oscillators 
are plotted in Figures 2 and 3, whose Allan variance characteristics are 
represented in Figure 4. Also shown in Figure 4 are plots of the standard 
deviation of time /Q ^ ( x ) divid j by t for comparison to the two-sample 
standard deviation. It has been suggested in the past that a procedure to 
estimate the standard deviation of time is to simply multiply the two-sample 
standard deviation by the elapsed time. These plots either verify that 
estimate or verify the validity of the derivation provided earlier. 

Kalman Filter Measurement Noise 


Suppose one uses a phase lock loop to track the phase difference between an 
oscillator and a reference frequency source as shown in Figure 5. The 
variance of the tracking error 3$ in radians due to phase noise of the 
oscillator is given as 


2 

a 6<t> 



V f > 4 - H PL J J2 ’ f )l 2df 


where 


1 - H pLL (j2*f)r 


f 4 + f N 4 


68 ) 


69) 
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FIGURE 2 S .NDARD DEVIATION OF TIME FOR A 5 PARTS IN 10 1U CRYSTAL OSCILLATOR 






TWO TYPICAL CRYSTAL OSCILLATORS 
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FIGURE 5 PHASE LOOP MEASURING OSCILLATOR PHASE 



of a phase lock loop with corner frequency f^ and damping ratio of /5?2, and 

2 

S^(f) is the phase noise spectral density represented in equation 9. a 
represents that part of the measurement error introduced into the Kalman 
Filter. It is usually affected mostly by the h2, hj and hg terms of S (J) (f), 
depending upon the loop bandwidth. 

In a laboratory environment, the measurement error whose variance is depicted 
in equation 69 may be the only measurement error of significance. However, in 
such systems as GPS, it is usually dominated by thermal noise and other system 
effects. 

SUMMARY AND CONCLUSIONS 

Because of flicker noise, good models of clocks for Kalman Filters can be 
elusive. In this paper we derived a two state model of clock characteristics 
that can be used in a Kalman Filter. It represents the characteristics of a 
clock described in terms of Allan variance parameters. We believe the models 
presented within this paper are a vast improvement over these used in most 
applications of the NAVSTAR GPS system, and that they could also be used in 
many other applications of time and frequency where real-time estimates and 
predictions of time and frequency are required. 
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QUESTIONS AND ANSWERS 


VICTOR REINHARDT, HUGHES AIRCRAFT CO.: I have a comment on f sub 
h and f sub 1. They are not really arbitrary, but real physical 
parameters that have to be set by the experiment. Just as with 
the white noise process, you have to set the bandwith before you 
can define the amount of noise that's going to enter the system. 
The white noise process is another process that requires the 
definition of the high frequency limit, and flicker noise, a low 
frequency limit. I think that's real effect, because the Allan 
variance goes to infinity. So, those are real things that you 
have to define, they are not arbitrary. I do think that you can 
leave those parameters as things to be defined by the person 
using the model. 

MR. BROWN: There was something that you said that I didn't 

understand. What is it that goes to infinity? The second 
difference is stationary, that is the reason that it is used. 

MR. REINHARDT: I am talking about the effect of having a dead 
time in the Allan variance, when the dead time between samples 
goes to infinity. The variance does go to infinity then. Or, if 
you have N samples, the process goes to infinity as log N. 

What this means is that there is definitely a low frequency 
cut-off parameter which has to be considered in your measurement 
process, which may not necessarily be associated with tau. 

MR. ALLAN: I think that one can make a general statement about 
this whole argument. The Kalman filter concept is strongly model 
dependent, and no model is perfect. The fact that, in the case of 
flicker noise, we may need to approximate the state matrix with a 
few terms doesn't bother me at all, because the model is 
approximate anyway. 

Whether you are talking about white noise or other noise, 
it's approximate at every leg of the trip, and you have to 
approximate for flicker noise or anything else. You have a finite 
measuring system bandwidth in the real world. You have low 
frequency and a high frequency cut-off, so these are only 
approximations to the ideal. I think that everything fits 
together rather well. 

MR. BROWN: I certainly agree with that. In this particular model 
that A1 and I have come up with, we were working especially hard 
to come up with a two state model, and there have to be serious 
approximations in that. 

I do plan to have a student working on this through the 
winter doing some simulations to see which of the two state 
models, or which of these options will work out to be the best. 
Of course, we are not absolutely limited to a two state model. We 
thought that it would be nice, with all the other approximations 
that go into the thing, to just keep it a two state model. 
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